Multiple models for outbreak decision support in the face of uncertainty.

Policymakers must make management decisions despite incomplete knowledge and conflicting model projections. Little guidance exists for the rapid, representative, and unbiased collection of policy-relevant scientific input from independent modeling teams. Integrating approaches from decision analysis, expert judgment, and model aggregation, we convened multiple modeling teams to evaluate COVID-19 reopening strategies for a mid-sized United States county early in the pandemic. Projections from seventeen distinct models were inconsistent in magnitude but highly consistent in ranking interventions. The 6-mo-ahead aggregate projections were well in line with observed outbreaks in mid-sized US counties. The aggregate results showed that up to half the population could be infected with full workplace reopening, while workplace restrictions reduced median cumulative infections by 82%. Rankings of interventions were consistent across public health objectives, but there was a strong trade-off between public health outcomes and duration of workplace closures, and no win-win intermediate reopening strategies were identified. Between-model variation was high; the aggregate results thus provide valuable risk quantification for decision making. This approach can be applied to the evaluation of management interventions in any setting where models are used to inform decision making. This case study demonstrated the utility of our approach and was one of several multimodel efforts that laid the groundwork for the COVID-19 Scenario Modeling Hub, which has provided multiple rounds of real-time scenario projections for situational awareness and decision making to the Centers for Disease Control and Prevention since December 2020.

Leveraging federalism for flexible and robust management of social-ecological systems

Managing social-ecological systems (SES) requires balancing the need to tailor actions to local heterogeneity and the need to work over large areas to accommodate the extent of SES. This balance is particularly challenging for policy since the level of government where the policy is being developed determines the extent and resolution of action.We make the case for a new research agenda focused on ecological federalism that seeks to address this challenge by capitalizing on the flexibility afforded by a federalist system of governance. Ecological federalism synthesizes the environmental federalism literature from law and economics with relevant ecological and biological literature to address a fundamental question: What aspects of SES should be managed by federal governments and which should be allocated to decentralized state governments?This new research agenda considers the bio-geo-physical processes that characterize state-federal management tradeoffs for biodiversity conservation, resource management, infectious disease prevention, and invasive species control.Read the free Plain Language Summary for this article on the Journal blog.

Optimal spatial evaluation of a pro rata vaccine distribution rule for COVID-19.

The COVID-19 Vaccines Global Access (COVAX) is a World Health Organization (WHO) initiative that aims for an equitable access of COVID-19 vaccines. Despite potential heterogeneous infection levels across a country, countries receiving allotments of vaccines may follow WHO's allocation guidelines and distribute vaccines based on a jurisdictions' relative population size. Utilizing economic-epidemiological modeling, we benchmark the performance of this pro rata allocation rule by comparing it to an optimal one that minimizes the economic damages and expenditures over time, including a penalty representing the social costs of deviating from the pro rata strategy. The pro rata rule performs better when the duration of naturally- and vaccine-acquired immunity is short, when there is population mixing, when the supply of vaccine is high, and when there is minimal heterogeneity in demographics. Despite behavioral and epidemiological uncertainty diminishing the performance of the optimal allocation, it generally outperforms the pro rata vaccine distribution rule.

Governance structure affects transboundary disease management under alternative objectives.

BACKGROUND: The development of public health policy is inextricably linked with governance structure. In our increasingly globalized world, human migration and infectious diseases often span multiple administrative jurisdictions that might have different systems of government and divergent management objectives. However, few studies have considered how the allocation of regulatory authority among jurisdictions can affect disease management outcomes. METHODS: Here we evaluate the relative merits of decentralized and centralized management by developing and numerically analyzing a two-jurisdiction SIRS model that explicitly incorporates migration. In our model, managers choose between vaccination, isolation, medication, border closure, and a travel ban on infected individuals while aiming to minimize either the number of cases or the number of deaths. RESULTS: We consider a variety of scenarios and show how optimal strategies differ for decentralized and centralized management levels. We demonstrate that policies formed in the best interest of individual jurisdictions may not achieve global objectives, and identify situations where locally applied interventions can lead to an overall increase in the numbers of cases and deaths. CONCLUSIONS: Our approach underscores the importance of tailoring disease management plans to existing regulatory structures as part of an evidence-based decision framework. Most importantly, we demonstrate that there needs to be a greater consideration of the degree to which governance structure impacts disease outcomes.

Projected resurgence of COVID-19 in the United States in July-December 2021 resulting from the increased transmissibility of the Delta variant and faltering vaccination.

In Spring 2021, the highly transmissible SARS-CoV-2 Delta variant began to cause increases in cases, hospitalizations, and deaths in parts of the United States. At the time, with slowed vaccination uptake, this novel variant was expected to increase the risk of pandemic resurgence in the US in summer and fall 2021. As part of the COVID-19 Scenario Modeling Hub, an ensemble of nine mechanistic models produced 6-month scenario projections for July-December 2021 for the United States. These projections estimated substantial resurgences of COVID-19 across the US resulting from the more transmissible Delta variant, projected to occur across most of the US, coinciding with school and business reopening. The scenarios revealed that reaching higher vaccine coverage in July-December 2021 reduced the size and duration of the projected resurgence substantially, with the expected impacts was largely concentrated in a subset of states with lower vaccination coverage. Despite accurate projection of COVID-19 surges occurring and timing, the magnitude was substantially underestimated 2021 by the models compared with the of the reported cases, hospitalizations, and deaths occurring during July-December, highlighting the continued challenges to predict the evolving COVID-19 pandemic. Vaccination uptake remains critical to limiting transmission and disease, particularly in states with lower vaccination coverage. Higher vaccination goals at the onset of the surge of the new variant were estimated to avert over 1.5 million cases and 21,000 deaths, although may have had even greater impacts, considering the underestimated resurgence magnitude from the model.

Collaborative Hubs: Making the Most of Predictive Epidemic Modeling

[...]models can vary in terms of what data they use, what they assume about transmission, and what analytic approach they use to produce projections. Because of this, relying on one model is dangerous because there is no guarantee that one model's choices and assumptions will yield an accurate prediction. In many fields, there is a long tradition of combining multiple models to mitigate this limitation by providing a single prediction that summarizes the view of the participating models.7 There has been a growing interest in using ensemble methodologies in epidemiology, with notable efforts in forecasting, risk prediction, causal inference, and decision-making.8-12 COORDINATION, COLLABORATION, AND EVALUATION A modeling "hub" is a consortium of research groups organized around a particular scientific challenge. The US COVID-19 Forecast Hub ensemble (including many component models) has struggled to produce accurate forecasts of cases and hospitalizations during periods of rapidly changing epidemic dynamics, such as the US peak of the winter wave in early 2021 or the rapid increases associated with the Delta variant in summer 2021 or in winter 2021-2022.3 Likewise, although longer-term projections from the COVID-19 Scenario Modeling Hub projected a Delta-associated resurgence in the United States, the ensemble significantly underestimated its speed and size, even though there were no clear deviations from scenario assumptions.13 However, even when projections are wrong, the hubs play a role in enhancing the scientific rigor and integrity of epidemic modeling. [...]operationally, there is value in developing procedures that harness the insights of a diverse network of scientists while guarding against groupthink and overconfidence.12 As researchers, system developers, and public health officials who have been deeply involved in the real-time operation of modeling hubs duringthe COVID-19 pandemic and prior epidemics, we believe the hub approach is a vital path forward for predictive disease modeling efforts.

Challenges in estimation, uncertainty quantification and elicitation for pandemic modelling.

The estimation of parameters and model structure for informing infectious disease response has become a focal point of the recent pandemic. However, it has also highlighted a plethora of challenges remaining in the fast and robust extraction of information using data and models to help inform policy. In this paper, we identify and discuss four broad challenges in the estimation paradigm relating to infectious disease modelling, namely the Uncertainty Quantification framework, data challenges in estimation, model-based inference and prediction, and expert judgement. We also postulate priorities in estimation methodology to facilitate preparation for future pandemics.

Synergistic interventions to control COVID-19: Mass testing and isolation mitigates reliance on distancing.

Stay-at-home orders and shutdowns of non-essential businesses are powerful, but socially costly, tools to control the pandemic spread of SARS-CoV-2. Mass testing strategies, which rely on widely administered frequent and rapid diagnostics to identify and isolate infected individuals, could be a potentially less disruptive management strategy, particularly where vaccine access is limited. In this paper, we assess the extent to which mass testing and isolation strategies can reduce reliance on socially costly non-pharmaceutical interventions, such as distancing and shutdowns. We develop a multi-compartmental model of SARS-CoV-2 transmission incorporating both preventative non-pharmaceutical interventions (NPIs) and testing and isolation to evaluate their combined effect on public health outcomes. Our model is designed to be a policy-guiding tool that captures important realities of the testing system, including constraints on test administration and non-random testing allocation. We show how strategic changes in the characteristics of the testing system, including test administration, test delays, and test sensitivity, can reduce reliance on preventative NPIs without compromising public health outcomes in the future. The lowest NPI levels are possible only when many tests are administered and test delays are short, given limited immunity in the population. Reducing reliance on NPIs is highly dependent on the ability of a testing program to identify and isolate unreported, asymptomatic infections. Changes in NPIs, including the intensity of lockdowns and stay at home orders, should be coordinated with increases in testing to ensure epidemic control; otherwise small additional lifting of these NPIs can lead to dramatic increases in infections, hospitalizations and deaths. Importantly, our results can be used to guide ramp-up of testing capacity in outbreak settings, allow for the flexible design of combined interventions based on social context, and inform future cost-benefit analyses to identify efficient pandemic management strategies.

Strategic testing approaches for targeted disease monitoring can be used to inform pandemic decision-making.

More than 1.6 million Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2) tests were administered daily in the United States at the peak of the epidemic, with a significant focus on individual treatment. Here, we show that objective-driven, strategic sampling designs and analyses can maximize information gain at the population level, which is necessary to increase situational awareness and predict, prepare for, and respond to a pandemic, while also continuing to inform individual treatment. By focusing on specific objectives such as individual treatment or disease prediction and control (e.g., via the collection of population-level statistics to inform lockdown measures or vaccine rollout) and drawing from the literature on capture-recapture methods to deal with nonrandom sampling and testing errors, we illustrate how public health objectives can be achieved even with limited test availability when testing programs are designed a priori to meet those objectives.